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Abstract 

A generalization of the Gibbs entropy postulate is proposed based on the BBGKY [Bogolyubov- 
Born-Green-Kirkwood-Yvon] hierarchy of equations as the nonequilibrium entropy for a system 
of N interacting particles. This entropy satisfies the basic principles of thermodynamics in the 
sense that it reaches its maximum at equilibrium and is coherent with the second law. By using 
a generalization of the Liouville equation describing the evolution of the distribution vector, it 
is demonstrated that the entropy production is a non-negative quantity. Moreover, following the 
procedure of non-equilibrium thermodynamics a transport matrix is introduced and a microscopic 
expression for this is derived. This framework allows one to perform the thermodynamic analysis 
of non-equilibrium steady states with smooth phase space distribution functions which, as proven 
here, constitute the states of minimum entropy production when one considers small departures 
from stationarity. 
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I. INTRODUCTION 



According to the mechanicistic interpretation of the physical world, the basic laws of 
nature are deterministic and time reversible. However, at the macroscopic level we observe 
irreversible processes related to energy degradation which generates entropy. How do we rec- 
oncile the 'spontaneous production of entropy' with the time reversibility of the microscopic 
equations of motion?. At the end of the nineteenth century, Boltzmann tried to answer this 
question from a probabilistic point of view. According to him, entropy is a measure of the 
lack of knowledge of the precise state of matter and can be defined as a function of the prob- 
ability of a given state of matter. This function associates a number Sg(X) = log | T a/(jst) | 
to each microstate A of a macroscopic system, with \Tm\ being the volume of the region of 
the phase space Tm corresponding to the macrostate M = M(X). The macrostate M is all 
of a group of states Y such that M(Y) = M(X) = M. In this sense, the Boltzmann entropy 
is a function of the microstate which at equilibrium coincides with the thermodynamic en- 
tropy. All systems in their irreversible evolution tend to a state of maximum probability or 
maximum entropy -the state of equilibrium-. 

In contrast to the Boltzmann entropy, the Gibbs entropy is not a function of the individ- 
ual microstate but rather a function of the probability distribution in a statistical ensemble 
of systems with both entropies coinciding at equilibrium. As a consequence of the incom- 
pressible character of the flow of points representing the natural evolution of the statistical 
ensemble in phase space , the Gibbs entropy is a constant of motion. Thus, it has been 
argued that the relevant entropy for understanding thermodynamic irreversibility is the 
Boltzmann entropy and not the Gibbs entropy^ - —. 

In addition, the problem of the diverging character of the Gibbs entropy related to the neg- 
ative sign of the entropy production in non-equilibrium stationary states apparently excludes 
the use of the Gibbs entropy in the statistical description of non-equilibrium systems^. This 
raises the question as to how to define the non-equilibrium entropy and if possible, to give 
a thermodynamic description of non-equilibrium fluctuations. In other words: can Thermo- 
dynamics describe systems far from equilibrium?—^. 

Thus, from the moment when Gibbs first postulated his entropy formula, the definition 
of the non-equilibrium entropy and its relation to irreversibility has been an outstanding 
problem, now compounded by the fact that the entropy production is negative in non- 
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equilibrium stationary states in apparent violation of the second law of Thermodynamics^. 
This constitutes an open problem which must be solved. 

A huge amount of work has been done on this subject trying to address the problem. 
On one hand, there have been attempts to extend the equilibrium entropy^ - — to non- 
equilibrium situations in order to avoid the divergence of the Gibbs entropy. On the other 
hand, work has been done to establish fluctuation theorems for the probability of the entropy 
production fluctuations^. In a previous work 1 - we showed a way to circumvent the difficulty 
of reconciling the second law of thermodynamics with the reversible microscopic equations 
of motion in the framework of the Bogolyubov-Born-Green-Kirkwood-Yvon (BBGKY) hi- 
erarchy. We proposed a functional of the set of s-particle reduced distribution functions as 
the entropy for a system of N interacting particles. This entropy does not enter into contra- 
diction with thermodynamics, and as we show here, in addition to being time-dependent it 
enables one to perform a thermodynamic analysis of the stationary non-equilibrium states. 
In this sense, our theory constitutes an extension of the scope of thermodynamics to systems 
away from equilibrium. 

We begin this contribution introducing in section 2 the representation of the state of an 
isolated system in terms of the hierarchy of reduced distribution functions. Afterwards, in 
section 3, we introduce a generalization of the Gibbs entropy postulate as the non-equilibrium 
entropy and derive the entropy production. After that, in section 4, we give the thermody- 
namic analysis of the non-equilibrium steady states of the system and establish a minimum 
principle for those states having obtained a phenomenological transport matrix previously. 
Finally, in section 5, we stress our main conclusions. 

II. HAMILTON! AN DYNAMICS 

Let's consider a dynamical system of N identical particles whose Hamiltonian 
H N (\q N ,p N }) is given by 



the system is completely specified at a given time by the N-particle distribution function 




(1) 



where m is the mass 




potential. The state of 
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F ({q N ,p N } ;i) which evolves in time according to the Liouville equation. Nonetheless, an 
strictly equivalent alternative description of the state of the system can be given in terms 
of the distribution vector— 

/ = {/ ,A(ri),/ 2 (r 2 ), Jn(t n )} , (2) 

with T s = (xi,x 2 , ,x s ) and Xj = (q.,p.)- Additionally, the set of quantities T s can be 

grouped as the vector T= {r 1; r 2 , , T N }, and correspondingly H= {Hi, H 2 , , H N } 

can be defined with H s being the s-particle Hamiltonian. The distribution vector represents 
the set of all the s-particle reduced distribution functions / s (r s ) (s = 0,....,N), defined 
through 

f s = 7^— J F(x 1 ,..,x s ,x s+1 ,..,x N ) dx s+1 ...dx N . (3) 

The evolution equations of these functions can be obtained by integrating the Liouville 
equation thereby constituting a set of coupled equations: the BBGKY hierarchy which can 
be written in a compact way as a generalized Liouville equation^ 

j t - VC\ fjt) = QCfJt) , (4) 



with 



(s\V£\s>) = 5 s , s ,{J2l° j + £ L' j>n \ (5) 

. j=l j<n=l 



= 5 S)S > [H s , ...} p , 

and 



s\QC\ s') = 6 S ,, S+1 / YL' dx s+1 . (6) 



where | s) represents the s-particle state defined through (r s |s) = f s (T s ) and where the 
projection operators V and Q, its complement with respect to the identity, give the diagonal 

and non-diagonal part of the generalized Liouvillian C, respectively. Here, L° = [H°, ...] p 

p 2 

, where [..., ...] p is the Poisson bracket, H° = and L'j n = [H'^ n , ...] p , with H^ n = \4>j, n - 
In the next section we will show that irreversibility is manifested in the dynamics of the 
system when the adequate description, i.e. in terms of the distribution vector is used. 
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III. NON-EQUILIBRIUM ENTROPY AND IRREVERSIBILITY 



As the expression for the non-equilibrium entropy we propose 

S = -k B Tr{f]o S {p 1 £)} + S 
N I r f n 

= -feV-r / f n \0g—^- dXi dx n + S , (7) 

tin\J fo,n 

a functional of /, generalizing the Gibbs entropy postulat e) 17 ' 18 , based on the fact that the 
distribution vector determines the state of the system. The Gibbs entropy postulate is 
also known as relative or Kullback entropy^ Here, k B is the Boltzmann constant, S a 
the equilibrium entropy and / is assumed to be the equilibrium distribution vector which 
corresponds with S a , satisfying Cf = 0, the Yvon-Born- Green (YBG) hierarchy. Moreover, 
S is maximum at equilibrium when /=/ giving S = S a , which can be proven by taking the 
first and second variation of S with respect to / while S Q and / remain fixed 

6S =-k B Tr [5 f log (p 1 /)} (8) 
showing that SS = at equilibrium when f — f and 

which is a negative quantity. 

As known the Gibbs entropy is a functional of the full phase-space distribution function. 
Since the flow of points representing the natural evolution of an isolated system in phase 
space is incompressible, this entropy is a constant of motion under the standard Liouville 
dynamics which is not the case for the generalized Gibbs entropy (J7J). This entropy is 
coherent with the second law according to which S increases in irreversible processes such 
as the relaxation to equilibrium from an initially non-equilibrium state. To prove this we 
compute the rate of change of S which can be obtained by differentiating Eq. (J7J) with the 
help of Eq. © 

= -k B Tr{ci\og (/;V)}^0. 
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This constitutes the entropy production corresponding to the relaxation passing from a non- 
equilibrium state to equilibrium. Two contributions to the entropy production a (fTUj) can 
be distinguished 

( r 1 = -k B Tr{p£f}og (Cl)} 

1 N 1 - f ( - \ 

= - J, Y ~\ Y / f»Pj ' [ ~^ TV i lo S Un + Y — 3>* ) dx l-- dx n , (11) 
n=l ' j=l J \ ij=i=l J 

where T is the equilibrium kinetic temperature, taking into account that the dependence of 
/ 0( „ in the velocities is given through a local Maxwellian and F-^ = —Vjtfij^. The second 
contribution is 



a 2 = -k B Tr{QCl\og( K r o 1 i)} 

N 1 f ( n d \ 



fn 

x\og—^-dxi dx n dx n+ i . (12) 

Jo,n 



After partial integration Eq. ()12j) gives 

02 = ~k B Y ^j/ Y (/ ^.n+l/n+l^n+lj " ^" log ^ 



AT , n 



fce ^ ff^MJ -^r h ^T~ dx i- dx n , (is) 

n=l j=l J U tj Jo,n 



where f n £.j{g^) = / Ej, n +ifn+idx n+1 . Hence, 



a 2 = -fc B Y ^ E • ( ~ fn dl °{L fo,n ) dx ^- dx - 

n=l j=l J \ i-j i-j / 

1 V 1 n . 



71=1 j=l 

Therefore, 

cr = (7i + a 2 . (15) 

At equilibrium when we substitute f o n for f n , a% and o"2 becomes zero, while in any other 
case these are not necessarily zero. Hence, the interaction among the different particles 
causing the correlations introduces the irreversibility into the system which is accompanied 



by a creation of entropy. Entropy should explicitly contain all the correlations among the 
particles through the reduced distribution functions according to Eq. ((7j). This is our most 
important result in this paper. Although one can find somewhat related analyses^ - —, as far 
as we know, this expression (JJJ) based on the BBGKY hierarchy has no direct counterpart 
in the previous literature. 

As compared to other definitions of entropy, Eq. (J7J) does not contain any coarse-graining 
since this would imply some kind of time-averaging in order to subsum a certain number of 
time-scales, a procedure absent in Eq. ((7J). In addition, the generalized Gibbs entropy (J7J) 
is not a constant of motion under the Liouville dynamics given by Eq. (0J). This dynamics 
introduces a trace-preserving transformation which in concomitance with the fact that Eq. 
(J7J) is a concave functional of the distribution vector leads to the positive character of the 
entropy production. In this framework we have shown in Ref.- 5 that by using the meth- 
ods of the non-equilibrium thermodynamics it is possible to recover the kinetic Boltzmann 
equation. In the light of these facts not contained in other definitions of the entropy in the 
literature the strength of our definition resides. Hence, it seems that the generalized 
Gibbs entropy ((Zj) built in the framework of the BBGKY hierarchy which explicitly incorpo- 
rates the correlations between all particles clusters in the system constitutes the appropriate 
description leading to irreversibility at the macroscopic level. 

In appendix A we give the local version constituting the valance equation of the specific 
entropy. 



IV. NON-EQUILIBRIUM STEADY STATES 

As a way of demonstrating the applicability of the framework established in the previous 
section which enables us to describe irreversibility in a N-body system, let us assume that a 
non-conservative field h(t) acts on this system, modifying the Hamilton equations of motion 

q. = — — + C^xx, ...x N )h(t) , 

—i 

p. = -^l + D i (x 1 ,...x N )h(t) , (16) 

— i 

where C_i(xj) and D_i{xj) are coupling functions which are assumed to be analytic. This drive 
introduces a compressible contribution to the flow in the phase space which is reflected in 
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the Liouville equation characterizing the phase space flow 

§i"-^ r = ~-iVF, (17) 

where = (x" c , x™), x™ c = (C Ji (xj),D i (xj))h(t) . Here, the full phase-space distri- 
bution function F should be an smooth function in order that Eq. (|ZJ) be applicable. This 
function is defined through 

1 - 

m=l 

with 7 m (t) being one among the M realizations (m = 1, , M) in the statistical mechanical 

ensemble associated to our N-body system, so that MF(Tn, t)dT^ equals the number of 
realizations contained in the infinitesimal phase space volume dT^ at time 1*24. 

In this context, some simulations have shown multifractal phase-space distributions^ - —. 
Although the multifractal nature of the phase space distribution functions has been 
stated , 2 ?i 2 ? , apparently this is not always the case. In fact, it has been shown that in 
the case of the Galton staircas o 3 ° l31 an initial strong fractal phase space portrait becomes 
smooth when the system is coupled to a more ergodic Hoover-Holian thermostat. 

To Eq. (JT7|) corresponds 

^--V(C-G))f=QCf (19) 



for the distribution vector, where Gf— -J^ (t^ C f^ and (s'\VGf\s) = 5 S>S '-^- ■ (r™ c f s j. The 

total rate of change of the entropy is given now by 

^ = k B Tr {G/ log (jT 1 /) } + a. (20) 

For a constant field h a steady state, dS/dt = 0, can be reached when both contributions 
appearing in the right hand side of the previous equation balance each other. In such a case, 
the distribution vector is / and the entropy production (fTUj) reduces to 

o st = -k B Tr{Gf_ s \o g (r^ L )} 

= k B Tr {/JT | log (£*/,)} . (21) 



S 



In an attempt to study the stability of this non-equilibrium steady state we come back 
to Eq. (|10|). From this equation we infer the phenomenological law 

l^-Hogf/; 1 /) (22) 

in analogy with non-equilibrium thermodynamics 1 -, where M is a transport matrix which 
in general might depend on the state of the system. Thus 

a = k B Tr {log (jr 1 /) M log } , (23) 

expressing a as a positive semidefmite quadratic form. Therefore, in light of our result 
corresponding to Eq. (jlUJI one can state that M is a positive semidefmite matrix which in 
addition should be Hermitian 

M{s\s') = M\s\s') = M c {s'\s) , (24) 

as predicted by the Onsager symmetry relations. Here t refers to the Hermitian conjugate 
and c stands for the complex conjugated. By comparing Eqs. (fTK|) and (f2*3*j) we can obtain 
a microscopic expression for M 

Tr {log (j; 1 /) Mlog (Cl)} 

= a 1 + a 2 , (25) 

where cxiand <r 2 are given by Eqs (fTTj) and (JHJ), respectively. In order to get a Lyapounov 
function for this system we can develop the expression ()23)1 as follows 

v = k B Tr {log (/;//) Mlog (/;//)} 
+2k B Tr {log (/;//) M log (CLt) } 
+k B Tr {log Mlog (/;V st ) } . (26) 

Notice that the second and third terms on the right hand side of this equation vanishes in 
view to the fact that Mlog (^f" 1 /^ = according to Eq. (}2*2*|) . On the other hand, for 
small departures from the steady state we can assume that M coincides with its value at 
the steady state. Thus, the remaining non-zero term in Eq. (}26|) provides us the desired 
Lyapounov function 

L{t) = k B Tr { log (/;//) M log (/;//) } (27) 
9 



which is a positive semidefinite quadratic form having its minimum value at the stationary 
state / . Hence, the steady state is the state of minimum entropy production. This is a 
result analogous to the one of the principle of minimum entropy production by I. Prigogine^, 
nonetheless, the later was formulated in the framework of the classical non-equilibrium 
thermodynamics applicable in the linear regime. 

V. CONCLUSIONS 

Here we have shown a representation of the statistical description of a many-body system 
in terms of the distribution vector which reveals the irreversible manifestation of the motion 
of this system at the macroscopic level. This manifestation is hidden when one works with 
the standard Liouville equation but at the level of the generalized Liouville equation this 
irreversibility becomes evident. The Liouville equation is a closed equation for the phase 
space distribution function while the generalized Liouville equation encloses a set of coupled 
equations, each one in itself representing a contraction of the statistical description. But, 
as I have mentioned previously, the full statistical description in terms of the phase space 
distribution function is entirely equivalent to the description in terms of the set of all the 
reduced s-particle distribution functions, the distribution vector, with no loss of information. 
In this scenario, we show that the entropy given through the proposed generalization of the 
Gibbs entropy postulate is not conserved throughout the motion in phase space. The key 
point is that our entropy contains all the correlations among the particles through the 
reduced distribution functions. We have proven that this entropy reaches its maximum 
value at the equilibrium state where it coincides with the thermodynamic entropy and that 
the entropy production is positive according to the second law. 

By applying the methods of non-equilibrium thermodynamics in phase space, i.e. in 
the framework of the mesoscopic non-equilibrium thermodynamics MNET , a theory which 
has been proved to be successful in deriving kinetic transport equations in some particular 
cases^ - — , we have obtained a phenomenological transport matrix relating the rate of change 
of the distribution vector with its conjugated thermodynamic force. We have proven that this 
is a positive semidefinite Hermitian matrix satisfying a kind of Green-Kubo relation. In this 
scenario, assuming that the full phase-space distribution function is adequately smoothed 
we have performed the thermodynamic description of the non-equilibrium steady states. We 
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have derived a minimum principle for those stationary states satisfied by the corresponding 
Lyapounov function which coincides with the entropy production referred to the steady 
distribution vector. 

Therefore, in our opinion we have reconciled the reversibility of the microscopic level of 
description with the irreversible macroscopic behavior giving a molecular basis to the Non- 
equilibrium thermodynamics not restricted to the linear range. This enables us to perform 
the thermodynamic description of non-equilibrium steady states that can be far away from 
equilibrium, avoiding divergences and possible violations of the second law referred to in 
the previous literature. Hence, the answer to the question raised at the beginning, can 
Thermodynamics describe systems far from equilibrium?, is obviously yes if one works at 
the adequate level of description, which corresponds to the distribution vector. 

Appendix: local form 

The local form corresponding to Eq. (fT4"j) is 

d 

—fi(x,t)s(x,t) 



N „ n 



\ Y Y J f n tj ' f ~ k B T ^j fo,n Y —hi J 6 ( Xl ~~ X ^ Xl dXn ( 2§ ) 



n=l j=l \ j¥=i=± 

or 

^p(q, t)s(q, t) 



1 N I n [ ( n \ 

fY^iY I f n lj ' [ ~ k B T ^j f ,n + Ej + ^ — hi ) S ( Xl ~ X ) dXl dx ndp , (29) 



where p(q,t) is the density and s(q,t) the specific entropy. 
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